Interactive design of multimodal user interfaces

Design Challenges of Interactive Spherical User Interfaces

We present our experience on designing interactive applications for Sphere, our multi-touch-sensitive spherical display prototype. We believe that the compelling application design for future non-flat user interfaces will greatly depend on exploiting some unique characteristics of the given form factor. While our observations primarily focus on spherical displays, we envision that the ideas pre...

Multimodal interactive error recovery for non-conversational speech user interfaces

Multimodal Interactive User Interfaces for Mobile Multi-Device Environments

Portable devices come with different individual limitations in user interaction like limited display size, small keyboard and different sorts of input and output channels. To allow ubiquitous, peripheral interaction, a flexible way to provide user interfaces for multiple devices and their different modalities is needed. However, current systems and formats do not sufficiently integrate advanced...

Interactive design of multimodal user interfaces : reducing technical and visual complexity

In contrast to the pioneers of multimodal interaction, e.g. Richard Bolt in the late seventies, today's researchers can benefit from various existing hardware devices and software toolkits. Although these development tools are avai lable, using them is still a great challenge, particularly in terms of their usability and their appropriateness to the actual design and research process. We presen...

Using Ontologies in Design of Multimodal User Interfaces

In this paper we introduce an ontology-based approach to the design of multimodal user interfaces. The main benefit of our approach is the unified ontology of multimodal interaction, where we have integrated the knowledge and common concepts from different domains of multimodal interaction in a uniform way. The unified ontology of multimodal interaction can be viewed as a tool that a designer o...